A machine learning approach for real-time cortical state estimation.

Objective.Cortical function is under constant modulation by internally-driven, latent variables that regulate excitability, collectively known as 'cortical state'. Despite a vast literature in this area, the estimation of cortical state remains relatively ad hoc, and not amenable to real-time implementation. Here, we implement robust, data-driven, and fast algorithms that address several technical challenges for online cortical state estimation.Approach. We use unsupervised Gaussian mixture models to identify discrete, emergent clusters in spontaneous local field potential signals in cortex. We then extend our approach to a temporally-informed hidden semi-Markov model (HSMM) with Gaussian observations to better model and infer cortical state transitions. Finally, we implement our HSMM cortical state inference algorithms in a real-time system, evaluating their performance in emulation experiments.Main results. Unsupervised clustering approaches reveal emergent state-like structure in spontaneous electrophysiological data that recapitulate arousal-related cortical states as indexed by behavioral indicators. HSMMs enable cortical state inferences in a real-time context by modeling the temporal dynamics of cortical state switching. Using HSMMs provides robustness to state estimates arising from noisy, sequential electrophysiological data.Significance. To our knowledge, this work represents the first implementation of a real-time software tool for continuously decoding cortical states with high temporal resolution (40 ms). The software tools that we provide can facilitate our understanding of how cortical states dynamically modulate cortical function on a moment-by-moment basis and provide a basis for state-aware brain machine interfaces across health and disease.

Neural criticality from effective latent variables.

Observations of power laws in neural activity data have raised the intriguing notion that brains may operate in a critical state. One example of this critical state is "avalanche criticality," which has been observed in various systems, including cultured neurons, zebrafish, rodent cortex, and human EEG. More recently, power laws were also observed in neural populations in the mouse under an activity coarse-graining procedure, and they were explained as a consequence of the neural activity being coupled to multiple latent dynamical variables. An intriguing possibility is that avalanche criticality emerges due to a similar mechanism. Here, we determine the conditions under which latent dynamical variables give rise to avalanche criticality. We find that populations coupled to multiple latent variables produce critical behavior across a broader parameter range than those coupled to a single, quasi-static latent variable, but in both cases, avalanche criticality is observed without fine-tuning of model parameters. We identify two regimes of avalanches, both critical but differing in the amount of information carried about the latent variable. Our results suggest that avalanche criticality arises in neural systems in which activity is effectively modeled as a population driven by a few dynamical variables and these variables can be inferred from the population activity.

Latent Dynamical Variables Produce Signatures of Spatiotemporal Criticality in Large Biological Systems.

Understanding the activity of large populations of neurons is difficult due to the combinatorial complexity of possible cell-cell interactions. To reduce the complexity, coarse graining had been previously applied to experimental neural recordings, which showed over two decades of apparent scaling in free energy, activity variance, eigenvalue spectra, and correlation time, hinting that the mouse hippocampus operates in a critical regime. We model such data by simulating conditionally independent binary neurons coupled to a small number of long-timescale stochastic fields and then replicating the coarse-graining procedure and analysis. This reproduces the experimentally observed scalings, suggesting that they do not require fine-tuning of internal parameters, but will arise in any system, biological or not, where activity variables are coupled to latent dynamic stimuli. Parameter sweeps for our model suggest that emergence of scaling requires most of the cells in a population to couple to the latent stimuli, predicting that even the celebrated place cells must also respond to nonplace stimuli.

State-aware detection of sensory stimuli in the cortex of the awake mouse.

Cortical responses to sensory inputs vary across repeated presentations of identical stimuli, but how this trial-to-trial variability impacts detection of sensory inputs is not fully understood. Using multi-channel local field potential (LFP) recordings in primary somatosensory cortex (S1) of the awake mouse, we optimized a data-driven cortical state classifier to predict single-trial sensory-evoked responses, based on features of the spontaneous, ongoing LFP recorded across cortical layers. Our findings show that, by utilizing an ongoing prediction of the sensory response generated by this state classifier, an ideal observer improves overall detection accuracy and generates robust detection of sensory inputs across various states of ongoing cortical activity in the awake brain, which could have implications for variability in the performance of detection tasks across brain states.

Learning to make external sensory stimulus predictions using internal correlations in populations of neurons.

To compensate for sensory processing delays, the visual system must make predictions to ensure timely and appropriate behaviors. Recent work has found predictive information about the stimulus in neural populations early in vision processing, starting in the retina. However, to utilize this information, cells downstream must be able to read out the predictive information from the spiking activity of retinal ganglion cells. Here we investigate whether a downstream cell could learn efficient encoding of predictive information in its inputs from the correlations in the inputs themselves, in the absence of other instructive signals. We simulate learning driven by spiking activity recorded in salamander retina. We model a downstream cell as a binary neuron receiving a small group of weighted inputs and quantify the predictive information between activity in the binary neuron and future input. Input weights change according to spike timing-dependent learning rules during a training period. We characterize the readouts learned under spike timing-dependent synaptic update rules, finding that although the fixed points of learning dynamics are not associated with absolute optimal readouts they convey nearly all of the information conveyed by the optimal readout. Moreover, we find that learned perceptrons transmit position and velocity information of a moving-bar stimulus nearly as efficiently as optimal perceptrons. We conclude that predictive information is, in principle, readable from the perspective of downstream neurons in the absence of other inputs. This suggests an important role for feedforward prediction in sensory encoding.

Erratum: Genetically expressed voltage sensor ArcLight for imaging large scale cortical activity in the anesthetized and awake mouse (erratum).

[This corrects the article DOI: 10.1117/1.NPh.4.3.031212.].

Genetically expressed voltage sensor ArcLight for imaging large scale cortical activity in the anesthetized and awake mouse.

With the recent breakthrough in genetically expressed voltage indicators (GEVIs), there has been a tremendous demand to determine the capabilities of these sensors in vivo. Novel voltage sensitive fluorescent proteins allow for direct measurement of neuron membrane potential changes through changes in fluorescence. Here, we utilized ArcLight, a recently developed GEVI, and examined the functional characteristics in the widely used mouse somatosensory whisker pathway. We measured the resulting evoked fluorescence using a wide-field microscope and a CCD camera at 200 Hz, which enabled voltage recordings over the entire cortical region with high temporal resolution. We found that ArcLight produced a fluorescent response in the S1 barrel cortex during sensory stimulation at single whisker resolution. During wide-field cortical imaging, we encountered substantial hemodynamic noise that required additional post hoc processing through noise subtraction techniques. Over a period of 28 days, we found clear and consistent ArcLight fluorescence responses to a simple sensory input. Finally, we demonstrated the use of ArcLight to resolve cortical S1 sensory responses in the awake mouse. Taken together, our results demonstrate the feasibility of ArcLight as a measurement tool for mesoscopic, chronic imaging.

Decoding thalamic afferent input using microcircuit spiking activity.

A behavioral response appropriate to a sensory stimulus depends on the collective activity of thousands of interconnected neurons. The majority of cortical connections arise from neighboring neurons, and thus understanding the cortical code requires characterizing information representation at the scale of the cortical microcircuit. Using two-photon calcium imaging, we densely sampled the thalamically evoked response of hundreds of neurons spanning multiple layers and columns in thalamocortical slices of mouse somatosensory cortex. We then used a biologically plausible decoder to characterize the representation of two distinct thalamic inputs, at the level of the microcircuit, to reveal those aspects of the activity pattern that are likely relevant to downstream neurons. Our data suggest a sparse code, distributed across lamina, in which a small population of cells carries stimulus-relevant information. Furthermore, we find that, within this subset of neurons, decoder performance improves when noise correlations are taken into account.